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Abstract. The dynamics of networks of interacting systems depends intricately on 
the interaction topology. When the dynamics is explored, generally the whole topology 
has to be considered. However, we show that there are certain mesoscale subgraphs that 
have precise and distinct consequences for the system-level dynamics. In particular, 
if mesoscale symmetries are present then eigenvectors of the Jacobian localise on 
the symmetric subgraph and the corresponding eigenvalues become insensitive to the 
topology outside the subgraph. Hence, dynamical instabilities associated with these 
eigenvalues can be analysed without considering the topology outside the subgraph. 
While such instabilities are thus generated entirely in small network subgraphs, they 
generally do not remain confined to the subgraph once the instability sets in and thus 
have system-level consequences. Here we illustrate the analytical investigation of such 
instabilities in an ecological meta-population model consisting of a network of delay- 
coupled delay oscillators. 
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1. Introduction 

Over the past decade networks have become the principal tool for the analysis of complex 
systems |l]. By describing a given complex system as a network of discrete nodes that 
interact via discrete links, a considerable simplification is achieved, but the complexity 
of the topology of interactions (and thus much of the emergent properties of the real 
world system) is retained. 

In some of the biggest success stories of graph and network theory the simplification 
that is achieved by treating a system as a network, enables a subsequent analytical 
investigation that links an emergent phenomenon to local properties of the nodes. 
Examples include for instance Euler's solution of the Konigsberg bridge problem and 
the giant-component transition in random graphs [2]. 

It is apparent that not all emergent phenomena can be traced back to node 
properties alone. Instead, progress has been made by linking phenomena to well- 
studied global properties such as the spectra of matrices. In particular, the spectra 
of the adjacency matrix and the different graph Laplacians contain information about 
the net's diameter [3|, the degree of modularity and the isoperimetry (i.e., how 
many edges have to be removed to cut it in pieces of a certain size) [s]. Also in 
studies of the dynamics on networks clever mapping to a spectral problem has often 
proved instrumental. Prominent examples include for instance the computation of 
percolation thresholds of networks [H] and the master stability function approach to 
synchronization [6|. 

A direct connection between dynamics and spectral properties can be made for 
dynamical systems close to steady states [7|. Here the relevant matrix is the Jacobian, 
which consists of the coefficients of a linearised system at the steady state. In a given 
dynamical system steady state is stable if all eigenvalues of the Jacobian matrix have 
negative real parts. Notably, this connection between the stability of steady states 
and the spectrum of the Jacobian holds in all dynamical systems including strongly 
heterogeneous ones. 

While linking emergent phenomena to spectral properties has led to considerable 
progress, it does not provide a satisfactory solution for the investigation of many real 
world networks, because the size of the network can be such that computation of the 
spectrum is infeasible and, more importantly, information on the network structure 
is often incomplete. Perhaps inspired by js], this has triggered a recent search for 
mesoscale subgraphs that permit conclusions on the spectra of important matrices and 
by extension emergent phenomena. 

Compared to statistical null-models, the spectra of real world networks [9 12 



display characteristic peaks, which can in part be linked to the statistical over- 



representation of certain subgraphs 10 13 . Thus, for instance, the multiplicity of the 



eigenvalue of a graph's Laplacian matrix has been found to increase with the number 
of star-like subgraphs with two or more leaf nodes [9, 14, 15 . A more applied approach 



was taken for instance in 16 which studied the impact of three-node subgraphs on the 
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stability of ecological food webs. 

Mathematically speaking, an eigenvalue of a network can be linked to a specific 
subgraph if the corresponding eigenvector v is localised on the subgraph. In this case 
the eigenvector v and the corresponding localised eigenvalue Ev('y) are independent 



of the topology outside the subgraph 12 . Thus, the localised eigenvector and the 



corresponding eigenvalue are preserved in all networks, in which the subgraph occurs. 

For a long time, the only well-studied examples for subgraphs with localised 
eigenvalues were star-like subgraphs, and complete subgraphs (cliques) flo]. Starting 
from the observation that spectral peaks are often associated with network symmetries 



17 , Mac Arthur and co-workers determined generic symmetry properties that lead to 



the localization of eigenvectors 18 , 19 . By describing these properties in terms of a 
net's automorphism group, they provided means to construct and classify arbitrarily 
large subgraphs with localised eigenvalues. 



The aim of the present paper and a companion paper 20 is to apply the results 



of 18 to the study of dynamics and hence discuss the effect of subgraphs with 
localised eigenvectors for network dynamics. In the present paper we demonstrate these 
consequences by investigating a system of delay-coupled delay oscillators, which has been 
previously proposed as a model for the ecological metapopulations and gene-regulatory 



nets [21j. In contrast to the food web model studied in 20 , the metapopulation model 
lends itself to a deeper analysis as it is a so-called factorising system f2T^. In these 
systems the effect of topology can be 'factored-out' such that eigenvalues of the Jacobian, 
which characterise the dynamics, can be written as eigenvalues of the adjacency matrix, 
which characterize the structure. While we exploit this property extensively to provide 
analytical results that illustrate our findings, we note that these findings are not limited 
to factorising systems. As the main result of the present paper, we show that it is 
possible to engineer subgraphs that have distinct dynamical consequences, irrespective 
of the embedding network. 

This paper is organized as follows: We start in Sec. |2] by recalling the conditions 
under which a mesoscale structure has localised eigenvalues. In Sec. [3} we introduce 
a class of models of delay-coupled delay oscillators. Using the generalized modeling 
approach, we derive bifurcation conditions that explicitly depend on the topological 
eigenvalues. In Sec. |4| we study model realizations that include BSS and show that the 
localised eigenvalues give rise to distinct instabilities of the system. Finally, in Sec. [5} 
we summarize and discuss our results. 

2. localised topological eigenvalues 

The topology of a network of N nodes can be described by an A x A matrix, the 
so-called adjacency matrix. In case of a directed network, this matrix is defined as 

^ _ fl if there is a link pointing from j to i 
\0 otherwise 
In case of an undirected network, Aij = Aji. 
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Figure 1. Decomposition of 
a network in a basic symmetric 
subgraph (BSS) and a residual 
graph. The BSS constitutes of 
inner nodes / (black circles) and a 
connecting node (open circle) . The 
residual graph constitutes of nodes 
R (grey circles). Lines with arrows 
denote directed links, lines without 
arrows undirected links. 



We say that a vector v G is a topological eigenvector of a network if it is 
an eigenvector of the network's adjacency matrix A. Below, we discuss under which 
conditions topological eigenvectors can be attributed to a specific subgraph. The 
discussion presented here aims to provide an intuitive understanding. For a rigorous 



analysis we refer the reader to 18, 19 



Let us consider a small subgraph that is part of a bigger network. We group the 
nodes of the network into three sets: the set / of inner nodes, which are in the subgraph 
and adjacent only to nodes of the subgraph; the set C of connecting nodes, which are in 
the subgraph but not in / which constitute the interface between the subgraph and the 
residual graph; and the set R of residual nodes, which are not in the subgraph (cf. Fig[T]). 

Below we say that a topological eigenvector is localised on a given subgraph, if the 
components of the eigenvector vanish in all nodes except those belonging to the set /, 
i.e. Vj = Vj G R, C. [|] The defining condition for a localised eigenvector is thus 

Ef = for all j e R,C 
^^■'="'= = ^-"^-lGCforall,G/ " 



k 



Let us discuss the implications of Eq. ([2]). First, consider nodes j G R. By 
definition, these nodes can only have neighbours k E R,C. As = V/c G R, C, 
we can conclude that (i) Eq. ^ is trivially fulfilled for j G R, and that (ii) the values 
of all coefficients Ajk, j E R and k E R U C can be changed without changing the 
right hand side of any of the Eqs. (|2]). In other words: changes of the residual graph's 
topology, its size and/or its coupling to connecting nodes do not affect the eigenvector 
property of v. 

Next, consider nodes j G C, i.e., the connecting nodes. These nodes have 
neighbours E R,C and G /, which contribute to the sum in Eq. (|2|). As Vk = for 
k E R,C, contributions from all R-neighbours and C-neighbours of a C-node vanish. 
Thus, Ylk ^jk'^k = requires that contributions from all I-neighbours of a C-node cancel 



I We note that the notion of localization used here differs from the one in 20 , where it was only 
required that the v vanishes on R. This difference is due to the present focus on engineering different 
functions in subgraphs, which requires an extra layer of 'insulation' from the residual net. 
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Table 1. Topological eigenvalues and eigenvectors of three BSS. Shown are a star- 
like subgraph, a directed triangle and a directed hexagon with one or two connecting 
nodes respectively. Inner nodes are denoted by closed circles and enumerated counter- 
clockwise beginning from the the upper left corner. Connecting nodes are denoted by 
open circles and enumerated last. Lines with arrows denote directed links, lines without 
arrows undirected links. We use the following abbreviations: 0„ := exp(27rni/3), 
^± := (1 ± VT3)/2, and C± (1 ± V7); +,- and the white -space denote 1,-1 
and 0. localised eigenvectors, are distinguished by vanishing values of the eigenvector 
on the connecting nodes (after the ' — '). Additionally we have marked the localised 
eigenvectors by a star (*). 



each other. [§} 

Finally, consider nodes j G /. The respective entries vj can be non-zero but are 
subject to two conditions imposed by Eq. ([2]): Firstly, as shown above, the first line 
of Eq. g requires that there are entries Vj j G I that sum up to zero. Secondly, for 
the general case of complex vj =: Pj + iQj, the second line of Eq. ^ requires that 
— Vj) = Im (c) for all j G /, i.e., that the accumulated phase difference of 
node to its neighbours is identical for all nodes j G /. Both conditions can be fulfilled 
if the Qj are equally spaced on the unit circle, which is the case if the nodes j G / are 



subject to symmetry relations 22 



Let us shortly summarize. The above reasoning showed that eigenvectors localised 
on a subgraph are retained in any network in which an arbitrary residual graph is 
attached in an arbitrary manner to the connecting node(s). Further, we motivated that 
localised eigenvectors occur on all subgraphs whose inner nodes are subject to symmetry 
relations. In the following we call those subgraphs basic symmetric subgraphs (BSS). 
Each BSS thus has one or more localised eigenvectors, whose corresponding eigenvalues 



§ This corresponds to the orbitwise cancelation criterion in 



18 
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appear in the spectrum of every network that contains the BSS. 

A classification of BSS with only undirected links and a recipe for their construction 



can be found in 18 , 19 . Because a generalization of the scheme to directed BSS is 
straightforward, the present paper focusses on dynamical implications, rather than 
providing a wealth of examples for topological localization. For illustration, we thus 
restrict ourselves to three generic BSS with both, directed and undirected links, which 
are shown in Table [U 



3. Delay-coupled delay oscillators 



In the following, we present a generalized model of delay-coupled delay oscillators, 
which we use to study the dynamical implications of localised topological eigenvalues. 



The class of models has previously proposed in 21 , but is here extended to the case of 



directed links which has not previously been considered. 

Delay networks constitute a powerful, and intensively studied framework for 
modelling biological systems 23 29 . Modelling aspects of biology often requires to 



reduce complex processes to simple steps within a mechanism. Delay terms in models 
can account for time requirements of complex processes, such as transcription, gestation, 
etc., without resolving the process in detail 30 . In the context of the present paper. 



delay networks offer also another advantage: Even small delay systems can exhibit 
complex dynamics, which allows us to study nontrivial dynamics in relatively small 
example systems 31 . In systems without delay, very similar results could be produced. 



but would require larger examples and a considerably more cumbersome notation. 

The analytical treatment of delay networks is generally demanding as even simple 
delay differential equations constitute infinite dimensional dynamical system and lead 
to transcendental equations 32 . We therefore focus on a class of delay-coupled delay 



networks on degree homogeneous networks, which are known to fall into a class of 
factorizing systems (2l] and thus can be treated analytically. 



3.1. The meta-population model 

We consider a directed network of nodes, corresponding to different patches that can 
be inhabited by a given species. Each node i has an internal dynamical variable Xi 
representing the abundance of the population within the patch. In time the variable 
Xi changes in time due to internal dynamics and due to coupling to other variables Xj 
according to 

X, = GiXl) - L{X{) + [^^^F{X|) - A,,F{X,)\ (3) 

j 

where r and 5 denote growth and travel-time delays, Aij and Aji denote entries of the 
adjacency matrix, and G, L and F are positive functions describing growth, loss, and 
migration, respectively. In the following we do not restrict the functions G, L, and 
F to specific functional forms, but consider formally the whole class of models, using 
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the approach of generahzed modelhng 33 35 . The class of models under consideration 



thus includes several well-studied examples such as the Mackey-Glass 23] and the Ikeda 



model 24 



3.2. Generalized stability analysis 

For simplicity we study Eq. (|3| on a network, in which every node has as many incoming 
links df^ as outgoing links c?"*^*, such that df^ = = di. In this class of networks, which 
includes all undirected networks, flows tend to balance unequal node loads. Thus, if the 
functions G, L and F are identical for all nodes, there is homogeneous steady state, in 
which all variables X* = X* are identical. 

We analyse the stability of X* by introducing normalized variables Xi = Xi/X* 



and normalized functions /(xj) 
rewrite Eq. ^ as 

a{g{xl))-lix,)+fiJ2[A,^fi 



F{xiX*)/F{X*). Using X* = X" 



X 



(5* 



we can 



(4) 



where a = G{X*)/X* = L{X*)/X* and /3 = F{X*)/X* are parameters that can be 
interpreted as characteristic turnover and transport rates. We set a = 1 by timescale 
normalization. 

The Jacobian matrix that governs the stability of steady states in the system can 
be expressed as a function of the quantities g', I' and /' that are defined as derivatives 
of the normalized functions with respect to the normalized variable Sj, or equivalently 
the logarithmic derivatives of the functions before normalization 



9 



dg_ 
dx 



x=l 



X* dG 
G^dX 



dlogG 



(5) 



x=x* ^logX 

Because we did not restrict the functional forms in the model the three quantities g', I' 
and /' are unknown constants that can be treated as parameters of the system. Defining 
the parameters thus, after normalization, has the advantage of yielding parameters that 



are generally easily interpretable in the context of the application 33 
Following [21] we write the Jacobian as 

J : Jij{X) = Jf5ij + J°A 



1 



(6) 



where 5ij is the Kronecker delta and 



r 



((7'exp(-Ar)-r)- W, (7) 
/3/'exp(-A5) (8) 

and the degree di, is the number of incoming and outgoing links connecting to node i 
and A is an eigenvalue of the J. 



3.3. Bifurcation conditions 



In a continuous-time dynamical system, a steady state is locally asymptotically stable 
if all eigenvalues, Ev(J), have negative real-parts and it is unstable if at least one 
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eigenvalue has a positive real part (7, 36 . Because the Jacobian of a delay system 
contains exponentials of its own eigenvalue A the characteristic polynomial of the 
Jacobian is typically a transcendental equation that can admit an infinite number of 
eigenvalues. 

To provide some analytical intuition we now focus on the case of degree 
homogeneous networks, where di = d* for all i, which enables an analytical computation 
of the eigenvalues. For simplicity of notation we will for the moment pretend that degree 
homogeneity is satisfied for the entire network. We emphasize however that for the 
computation of localised eigenvalues and eigenvectors, we only need to assume degree 
homogeneity within the I-nodes, which is often true because of symmetry. Because the 
localised eigenvectors and eigenvalues are insensitive to the network structure outside 
the BSS, they are also insensitive to a violation of the degree homogeneity assumption 
if the violation occurs outside the BSS. It can be shown that essentially the same is true 
for the C-nodes. 

For degree-homogeneous networks all diagonal elements of the Jacobian are identical 
such that Jf =: J'^. We can then write 

J = J^I + J°A (9) 

where I is the identity matrix. The eigenvalue computation then becomes 

Ev(J) = Ev( J'^I + J°A) = J'^ + J°Ev(rmA) (10) 

This equation establishes a relationship between the topological and dynamical 
eigenvalues of the system. However, we emphasize that both J'^ and J° depend on 
A. The relationship (10) thus constitutes a self-consistency condition that typically 
admits an infinite set of dynamical eigenvalues for each topological eigenvalue. For a 
given topological eigenvalue q this condition reads 

A = J'i(A) + c,J°(A). (11) 

Instead of trying to compute the dynamical eigenvalues, we focus on the 
computation of bifurcation points where the stability changes and eigenvalues cross 
the imaginary axis in the complex plane, so that A = iu. Separating the real and 
imaginary part of Eq. (11) yields 

= g' cos(0) - I' -dk+ |c|fc cos(^), (12) 
w = — sin(0) — |c|A; sin('?/'), (13) 

with = ojT and ip := u6 — tp^ , where tp^ is the complex phase of Cj. 

The bifurcation condition is thus given by an equation system with three unknown 
variables, 0, ip cind u. For every solution triplet (0, '0, w), we find another solution 
(— 0, —ip, —u), providing the same bifurcation lines. We therefore only consider solutions 
with oj > 0. Further, we are only interested in solutions for positive delays, r > 0, and 
thus only consider solutions with > 0. We now choose as a free parameter to find 
parametric representations of the bifurcation lines. This is done separately for three 
cases Id = 0, IcI = d, and < IcI < d. 
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For c = 0, Eqs. ( 12p3 ) are independent of tp, 5 respectively. Thus, the bifurcations 
are vertical lines in the (A;, 5)-plane, which are solely characterized by 

with h := ((y''cos(0) — 1')t, where has to satisfy = 0, with / := + g'r sm{(j)). For 
the parameter values used throughout this paper, the condition /(0) =0 has a unique 
solution. 

For |c| = d, we find 

'=-r^dh- ^''^ 
In order to obtain positive solutions, h{(j)) needs to be positive. Therefore, we have to 
restrict to the intervals l!^ = [27ir + (f)^,2TT{r + 1) — (p^], where r is a non-negative 
integer and (p^ = cos~^{l' /g'). The corresponding 6 values can be calculated using the 
Eqs. ( plpj ), which yield 

S-.- = t^+jk±^r, (16) 
T R 1 / V — q' cos(</)) \ , , 

^L,R ^ ^ ^ ^ . (17) 



^ + - 




c 


c 



for non-negative integers s. Thus, after calculating k with Eq. (15), we are able to 
calculate 5. In order to obtain valid solutions, we need to apply the L-branch for all 
/((/)) < and the R-branch otherwise. 
Finally, for < |c| < rf, we find 



ldh± 

^1,2 = --^ (1^ 

T d^ — \c\ 

with 

a = d^h^ -{d^ -\c\^){f + h^). (19) 

In order to obtain real and positive solutions, not only /i(0) needs to be larger than but 
also a(0). This sets additional restrictions to 0, which can be calculated numerically. 
In contrast to the case |c| = d, valid solutions can only be found inside a finite number 
of intervals The corresponding values for 5 are calculated as for |c| = d. 

In the latter two cases, two integers r and s enumerate different solution branches. 
From Eq. (16), we see that increasing s shifts the bifurcation lines towards larger values 
of 5. By contrast, the influence of r is less obvious. While different values of r correspond 
to distinct bifurcation lines in the parameter space, solutions that differ only by s often 
connect to each other such that they correspond to different segments of the same 
bifurcation line. 

The results from the Sec. [2] and |3] enable us to calculate the bifurcation points of 
instabilities that are created in BSS in which all C-nodes have an identical degree d. 
Even in large and complex networks instabilities that are generated entirely in certain 
symmetric subgraphs can thus be understood analytically. 
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4. Mesoscale induced instabilities 

The results of the previous sections imply that a given BSS has a characteristic set 
of bifurcations that will appear in every network that contains the BSS. In the present 
section we support this conclusion with numerical evidence. 

Because the computation of the potentially infinite set of eigenvalues is difficult, 



we use the approach proposed in 21 , 37 , which uses Cauchy's argument principle to 
compute the number of eigenvalues with positive real parts. In the following we apply 
these approach to analyse networks with a given topology. For each of these networks 
we consider a large ensemble of {k,6) parameter pairs that are drawn independently 
from a uniform distribution. We show this ensemble as a scatter plot in the (/c,5)-plane, 
in which we colour-code the number of eigenvalues with positive real parts. As a result 
we obtain plots such as the ones shown in Fig. [2| where changes in colour indicate 
bifurcation lines. 

As a first example, we consider two networks containing the triangular BSS from 
Table [Tj For the directed triangle, d = 2 as every inner node of the BSS has two incoming 
and two outgoing links. The bifurcation lines induced by the localised topological 



eigenvalues, c = exp(27rz/3) and c = exp(47r/3), can thus be calculated using Eq. (18). 
The scatter plot for the isolated BSS (Fig. [2| top left) shows a number of bifurcation 
lines. Some of these lines arise from delocalised instabilities. However, two of the 
bifurcation lines correspond to characteristic instabilities of the triangle. These lines 
agree exactly with the analytical results. 

Let us now consider the more complicated example shown on the right hand side 
of Fig. [2] which also contains the directed triangle BSS. For the larger network the 
corresponding scatter plot is significantly more complex. Note in particular that the 
delocalised instabilities that were present in the isolated triangle BSS do not carry over 
to the complex network. However, as we have shown analytically, the characteristic 
instabilities are independent of the embedding topology. Thus, the bifurcation lines 
corresponding to characteristic instabilities reappear exactly also in the larger network. 

The effect of the characteristic instabilities on the system can be visualized by 
simulations (Fig. [2| bottom). In contrast to the results above, which are valid for 
the general class of models, simulations require restricting the functional form of the 
equations of motion. We use coupled Mackey-Glass systems 

= -cX, + eJ2 (^..^. - , (20) 

with a = 2,b = 5,0 = 1, e = 10, r = 5 corresponding to the generalized parameters 
g' = —1.5,1' = 1, k = er = 1. The simulation results show that the two characteristic 
instabilities correspond to clockwise and counter-clockwise oscillations on the triangle. 
One can therefore think of the directed triangle BSS as a network motor that will 
induce a characteristic forward or reverse oscillation if specific conditions are met, 
independently of the embedding topology. Let us emphasize that these oscillations do 
not generally remain confined to the triangle subgraph. After the onset of oscillations 
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Figure 2. Characteristic instabilities induced by the directed triangle subgraph. Top 
row: Diagrammatic representation of two network topologies, specifically the directed 
triangle with connecting nodes (left) and the a larger network containing the directed 
triangle subgraph. (Symbols as in Table 1). Center row: scatter plots showing the 
stability of specific pairs of the parameters {k, S). Colour coded is the number of 
dynamical eigenvalues with positive real parts, such that white corresponds to the 
region where the homogeneous steady state is stable. The solid and dashed lines 
correspond to analytical results for bifurcations that are localised in the triangle 
subgraph. The agreement between the scatter plot and the analytically obtained 
bifurcation lines show that the bifurcation lines of the two localised eigenvalues of 
the BSS are not affected by the residual graph. Bottom row: Time series from a delay- 
coupled Mackey-Glass systems with different parameters k and S, marked by crosses 
in the scatter plots. Colours correspond to different variables of the triangle subgraph, 
showing that the two localised instability correspond to right-handed and left-handed 
oscillations respectively. Parameters are g' = — f .5, = 1, fc = 1, r = 5. 



the propagation of the oscillatory solutions across the network is not described by the 
same Jacobian and the delicate balance which isolates the instability can be destroyed 
in the non-stationary state. 

Two more complicated examples are shown in Fig. |3j The figure shows the scatter 
plots obtained for model realization on two different networks, which both contain the 
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coupling strength k coupling strength k 



Figure 3. Characteristic instabilities induced by different symmetric subgraphs. Plots 
are analogous to Fig. [2j Both scatter plots contain the characteristic instabilities 
induced by the hexagonal BSS (solid black lines). Additionally, the network on the 
right-hand side contains also the characteristic instabilities of the directed triangle 
BSS (dashed, cf. [2]) and the star-like BSS (dotted, vertical). For details on the 
corresponding localised eigenvalues see Table 1. This figure shows that characteristic 
instabilities induced by different BSS occurring in the same network superimpose 
without interfering. 

hexagonal BSS with two connecting nodes. The network on the right-hand side moreover 
contains the star-like BSS and the directed-triangle BSS. In both scatter plots, we 
find the characteristic bifurcation lines of the hexagonal BSS, corresponding to the 
topological eigenvalues c = 0, c = 2exp(27r?/3) and c = 2 exp(47ri/3). The two-fold 
degeneracy of the eigenvalue c = is refiected in the number of positive eigenvalues 
changing by 4 instead of 2 when crossing the corresponding bifurcation line (solid 
vertical line). In the scatter plot on the right, we further find the bifurcation lines 
of the triangular BSS (cf. Fig. |2]) and the bifurcation line originating from the localised 
eigenvalue c = of the star-like BSS. This confirms that bifurcations induced by different 
BSS can be superimposed without interfering. 

5. Conclusions 

In the present paper we showed that symmetric subgraphs induce characteristic localised 
instabilities. The bifurcations arising from these instabilities occur independently of 
the structure of the embedding network. These results have two implications. First 
they provide a wealth of examples of mesoscale structures that have precise and 
distinct implications for system-level dynamics. Second, because these implications are 
independent of the embedding structure, they can be analysed in small, structurally 
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simple systems. Therefore, analytical solutions can be obtained even for relatively 
complicated dynamics such as the delay-coupled delay systems studied here. 

The beauty of the results lies perhaps in their simplicity. Essentially a symmetry in 
topology translates into a symmetry of topological eigenvalues in the complex plane, 
which then translates into a symmetry of dynamic eigenvalues, and onward to a 
corresponding dynamical mode. Here we have mainly considered the case of cyclic 
structures such as the directed triangle, which cause corresponding cyclic modes. It 
can be easily extrapolated that for instance bipartite structures caused characteristic 
instabilities that correspond to an imbalance between the partitions. For instance 
in a directed four-cycle, one would expect four cyclic instabilities and an additional 
instability where two nodes start to suppress the other two. 

Although the connection between mesoscale structure and dynamics may be 
intuitive, we note that it is only exactly true in the special case of exact symmetry that 
is not generic in the mathematical sense. In a completely random system, one would 
not expect that any dynamical instability localises exactly on a finite set of nodes. It 
has been pointed out by 18 that symmetric structures are relatively common in real 
world networks, with up to 80 % of the nodes belonging to symmetric structures in 
some examples. However, the symmetry of the Jacobian matrix on which we build here, 
requires additionally that the symmetric nodes also follow the same dynamical rules. In 
many biological systems this requirement is only be met exactly in special situations. 
Nevertheless, we expect the present results to remain valid to good approximation if the 
dynamical differences between topologically symmetric nodes are reasonably small (e.g. 
in a metapopulation where topologically symmetric nodes correspond to patches with 
similar but not identical environmental conditions). Furthermore, it is easily conceivable 
that almost exact symmetries exist in many technical systems. The exploration of both 
technological and biological implications of the present work, appear to be promising 
targets for future work, including the analysis of real-world data. 

Despite the caveat above, the connection between mesoscale structure and dynamics 
should remain valid in a wide variety of different systems. In the present paper 
we illustrated this connection by the example of delay-coupled delay oscillators. For 
simplicity we focused on topologies where the number of a node's outgoing links is 
identical to the number of incoming links. Furthermore, we only considered symmetric 
subgraphs in which all inner nodes had the same number of links, such that the system 
was factorizing. While these assumptions were essential for a clean illustration of the 
results, very similar results could have been obtained in other systems. First, we 
have focused here on delay-coupled delay oscillators, because they provide non-trivial 
examples, where already very simple structures can sustain complex dynamics. The 
same reasoning could have been presented for ordinary differential equations or discrete 
time maps, although perhaps slightly more complex symmetric subgraphs would have 
been needed to provide interesting examples. Second, the balance condition for links 
allowed us to avoid the computation of steady states which is impossible with the chosen 
degree of generality, but does not otherwise affect the subsequent reasoning. Third, the 
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factorization enabled us to establish an explicit relationship between the topological and 
dynamical eigenvalues. We expect that the same will be possible for many symmetric 
structures and systems. However, even if this is not the case, a symmetry in the structure 
will generally induce a corresponding symmetry in the Jacobian if the symmetric nodes 
follow the same dynamical rules. Thus, even when the connection between structure and 
dynamics cannot be made explicit, a structural symmetry in a subgraph will generally 
induce characteristic instabilities that are independent of the embedding network. 
Because these instabilities originate in small sub-systems their numerical investigation 
should in general be possible with relative ease (see 20 for an example). 

One difficulty that may be encountered in future work is that the Jacobian can be 
sensitive to the location of the steady state. While an embedding network cannot affect 
the characteristic bifurcation lines in the bifurcation diagrams shown here, it can, by 
shifting the steady state, alter the parameter values at which the system is located within 
the bifurcation diagram. Our results would thus have been less clear if did not use the 
generalised modelling formalism that conceptually separates the effects of shifting steady 



state concentrations from the effects of changes in the nonlinearities 33 . In practice 



this means that subgraphs, such as the directed-triangle, can be constructed to sense 
some information from the surrounding network if this information is communicated 
via a change in the steady state values of the variables associated with the symmetric 
nodes. Conversely, one can also construct networks that are completely insensitive to 
the surrounding network. This can be done for instance by choosing the functional forms 
of the processes in the model to follow power laws. For such functions the generalized 
parameters that appear in the Jacobian are independent of the steady state under 
consideration (cf. Eq. ([s])). 

In conclusion, the work presented here points to a general connection between the 
structure of certain mesoscale subgraphs and system-level dynamics. It is conceivable 
that, in future works, this relationship may prove instrumental for understanding 
or engineering certain dynamics in complex nonlinear systems. For instance our 
results seem to suggest that networks can be constructed such that some function 
that is sustained on a certain part of the network can be isolated from functions 
that are localised on other parts of the net. Such localization is indeed observed in 
many biological networks, but significantly more work will be necessary to determine 
whether the symmetries described here contribute to this localization. Furthermore, 
attempts could be made to engineer simple information processing systems based on 
communicating symmetric subgraphs that are embedded in a larger network. While 
much work remains to be done to explore these possibilities we believe that, if successful, 
these efforts might lead to design principles for information processing in applications 
such as synthetic biology or chemical computing. 
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